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[57] ABSTRACT 

An image processing system and method for converting an 
Input image having continuous tone regions and binary 
regions into a binary output image includes a block evalu- 
ation system that generates a plurality of characteristic 
values for each block of the input image, and determines a 
block attributes for each block based on the plurality of 
characteristic values. The image processing system and 
method converts the input image into the binary output 
image on a block-by-block basis using one of a binary region 
conversion process or a continuous tone region conversion 
process, wherein the conversion process for each block is 
selected based on the determined block attribute. In addition, 
the* image processing system and method corrects the deter- 
mined block attribute based on the block attributes of each 
block and other blocks surrounding each block. Further, the 
image processing system and method detects when state 
transitions between block attributes of adjacent blocks 
occur, such that the conversion process selection is further 
controlled by the detected state transitions, based on either 
the block attributes for each block and other blocks sur- ( 
rounding each block, or the distribution of black, white, and 
gray pixels in each block. Finally, in the image processing 
system and method, the block attribute correction and the 
state transition detection can be used together. 

19 Claims, 27 Drawing Sheets 
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IMAGE PROCESSING METHOD AND evaluated portions are prevented from standing out in the 

SYSTEM binary output image by detecting blocks in which erroneous 

evaluations are easily produced and switching the coover- 

BACKGROUND OF THE INVENTION sion method within this block or switching the conversion 

— 5 method based on the pixel density of this block relative to 

1. Field of the Invention ^ ^ ^ cvaluation of ^ mounting blocks. 
This invention relates to an image prc^singn^thc^ and conversion process takes the mixed binary 

system which conduct a density conversion process in order ^ contmuou y s ^ . t ^ md outouts a binary ^ y 

to store in memory pnnt or display an image, input in ou ^ t ^ ^ leforp ^^^^ 

multiple density levels, in which characters and photographs 1Q 0 Xaryinly devices, such as a binary printer, a mono! 

are intermixed. chrome monitor and the like. 

2. Description of Related Art m each of the preferred embodiments, the image process- 
Conventionally, with image processing systems such as ing system ^ method of this invention extract two char- 
scanners, photocopy machines and facsimile machines actC ristic amounts for each region or block of the multiple 
which can only output binary images, a simple binary is ^^.^1 input image, namely the number of black 
conversion process is used on binary regions, such as pixcls (Qr ^fen^y the number of white pixels) and the 
characters, line drawings and the like, in order to make the ma^mum density difference, and evaluate each region to 
edges of these regions sharp and clear in the binary output determine whether the region is a binary region or a con- 
image. An error diffusion method as a continuous tone t0 ne region using the two characteristic amounts, 
conversion process is used on continuous tone (i.e.. gray- 20 -^^0^ the region evaluation precision is increased com- 
scale) regions, such as photographs, in order to generate the pared tQ ^ ^ rC gj on evaluation methods that use only 
plurality of different image density levels or density grada- 0Qe characterist j c amount In addition, both characteristic 
tions in the binary output image. However, there are a large amounts are <ktermined using simple processes, so only a 
number of documents, such as catalogs and the like, within short processing time is needed and can be implemented in 
which binary regions, such as characters, line drawings and 25 hardware without difficulty. 

the like, are intermixed with continuous tone regions, such ^ ^ rf ^ ^ cmbodimeDtS4 C0T . 

as photographs. In these documents it is necessary to erroneous region evaluations is performed, after 

evaluate each region in the document and to conduct the ^ ^J^ 1 ^ OD ^ ^ attributes of 

appropriate conversion process on each evaluated region to surTOU * nding ^ons. where the regions are formed of blocks 

generate the binary output image. 30 ^ Mvijy pixds mdicate whether a 

To solve this disadvantage, a method is proposed in re g on {$ a binary region or a continuous tone region, with 

Japanese unexamined patent publication 58-3374. In this mc binary re gi 0 n attribute being a logic high signal 

reference, the input image is divided into blocks. (hereinafter a "1") and the continuous tone region attribute 

The blocks are evaluated by finding the difference t^ing a i 0 ^ c | ow signal (hereinafter a "0"), for example, 

between the maximum image density and the minimum Thus, it is possible to further enhance the precision of the 

image density in each block. In Japanese unexamined patent region evaluation. Further, a pattern matching method or a 

publication 58-115975, another method is used. In this majority determination method is used as the correction 

reference, the blocks are evaluated by finding the edge method, making it possible to obtain sufficient results with 

density of each block. ^ a simple hardware structure, 

However, in these two prior art methods, the region Furthermore, in other ones of the preferred embodiments, 

evaluation precision is low, because only one characteristic a f tcr me K g on evaluation process is complete, the existence 

amount is used when evaluating the blocks. In addition, or ^ck of existence of a state transition between adjacent 

another disadvantage is that erroneously evaluated regions rC gions is detected, wherein a state transition occurs when 

stand out in the binary output image because no correction ^ me Tt ^ on attribute changes from binary to continuous tone 

method for correcting the evaluation erroneously evaluated OT yi cc vcrsa jjj regions where no state transition exists, the 

regions has been provided. binary output signals are generated for binary regions and 

CfTMMAttY OFTHF INVENTION foT COD tinuous tone TC & ons far ^ P* cls * D TC ^° n ' 

SUMMARY OF THE INVENTION bascd on mc rcgion evaluation results. In regions where a 

This invention thus provides an image processing method M state transition exists, switching between the binary output 

and an image processing system which conduct a density signals generated by the binary conversion process and the 

conversion process on an image having intermixed binary continuous tone conversion process for the region having the 

and gray- scale regions, in order to store to memory, or to state transition is performed based on either the region 

print or display the converted image. attributes of the surrounding blocks or the state transition. 

This invention further provides an image processing 53 Therefore, it is possible to keep errors from standing out in 

method and image processing system wherein the region the binary output image. 

evaluation precision is improved by using two characteristic jq addition, in some of the preferred embodiments, after 

amounts, specifically the number of black pixels and the mc correction of erroneous region evaluations has been 

maximum density difference. completed, the attribute of the target region is corrected 

This invention also provides an image processing method 60 based on the attributes of the surrounding region, and then 

and image processing system wherein the region evaluation the existence or lack of existence of a state transition 

precision is further improved by correcting the results of the between adjacent regions is detected. In regions where it is 
target block or pixel evaluation by referring to the results of determined that no state transition exists, the binary output 

the target block or pixel evaluation for surrounding blocks or signals are generated by either the binary conversion process 

pixels following the target block or pixel evaluation. 65 or the continuous tone conversion process fox all pixels in 

This invention additionally provides an image processing the region based on the region evaluation correction results, 
method and image processing system wherein erroneously In regions where a state transition exists, switching between 
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the binary output signals generated by the binary conversion means for converting the density of the multiple density 
process and the continuous tone conversion process in the level input image, a characteristic amount extraction means 
region having the state transition is performed based on for extracting a plurality of characteristic amounts contained 
either the corrected attributes of the surrounding regions or by the input image, a region evaluation means for evaluating 
the pixel density of the corrected region having the state 5 each region as one of the binary region or the continuous 
transition. By this means, it is possible to make the binary tone region on the basis of the plurality of characteristic 
output image cleaner. amounts extracted by the characteristic amount extraction 
One embodiment of the preferred binary output image means, region evaluation correction means for correcting *e 
signal switching method of this invention comprises a region evaluation, and a signal selection means for switch- 
characteristic amount extraction process that extracts a plu- « *g between binary output image signals generated by either 
rality of characteristic amounts containedin the inputimage; Ac binary conversion process or the continuous tone con- 
a region evaluation process that evaluates each region as one version process based on the evaluation results of the region 
of a binary region or a continuous tone region based on the evaluation means. 

plurality of characteristic amounts extracted by the charac- Yet another preferred ernbodiment of the image process- 

teristic amount extraction process; and a signal selection « ing system of this invention comprises a density conversion 

process that, based on the evaluation results of the region means for converting the density of the multiple density 

evaluation process, outputs a binary output image signal level input image, a characteristic amount extraction means 

converted from the input image by either the binary con- for extracting a plurality of characteristic amounts contained 

version process or the continuous tone conversion process. by the input image, a region evaluation means for evaluating 

Another embodiment of the preferred image signal 20 each region as one of the binary ^^ h ^^ 

switching method of this invention^»riumses a character- «>ne region on the basis of me plurahty of clastic 

^ f nhwr ^ itv amounts extracted by the characteristic amount extraction 

is tic amount extraction process that extracts a plurality ot . . ' . . - . . . . 

" r\ , * • i • . . • _ r means, state transition detecting means for detecting, based 

characteristic amounts contained in the input image; a region 6 , . ° 

oiaittwciwuu oaivuuw ^wuu y e ^ evaluation results of the region evaluation process. 

evaluation process that evaluates each region as one oi a v " _ w _ . , , . . . J~ ^ 

. „ . . , -rl A _ fK . 25 whether or not certain blocks of pixels in the input image are 

binary rem on or a continuous tone region based on the " . . , r . ^ . ° 

vuiwy 1 *&» U w " . " t ^zl- k., . in a state of transition between the binary region and the 

plurality of characteristic amounts extracted by the charac- lu ' OM1 * "* . , „ flL^™ „„h « 

Eristic amount extraction process; and a signal selection continuous tone region reUuveto surrounding btoc^. and a 

pocess that based on the evaluation results of the region j*"* selection means f or ^f^^^^^ 

Valuation process, detects whether or not certain blocks of ^ binary convemon^process ^^na^^co^ 

, . /. . . .„ „ „fir a «c,-h' rt t, w^iv^n 30 sion process based on the evaluation results of the region 

pixels in the input image are in a state of transition between ^ " , . , , . , , 

*. ™ T* tMM „ .„ —i.h-™, trt evaluation process relative to all pixels in the specific block 

the binary region and the continuous tone region relative to , u,. 1. A»t*~;™ 

— outputs a ^^2- -If ^711^^^ 

based orTthe evaluation results of the region evaluation 35 l»»ce« based on Ute state trans«.on in the specific block 

process relative to all pixels in the specific block when no when such a sttte ttansition exists. 

such state transition exists, and switches between the binary These and other features and advantages of the wveouon 

conversion process and the continuous tone conversion are described m or apparent from the following detailed 

process based on the state transition in the specific block description of the preferred embodiments. 

when such a state transition exists. BRIEF DESCRIPTION OF THE DRAWINGS 

Yet another embodiment of the preferred image signal The invention will be described in conjunction with the 

switching method of this invention comprises a character- following drawings in which like reference numerals des- 

istic amount extraction process that extracts a plurality of ignate like elements and wherein: 

characteristic amounts contained in the input image; a region 4J nG j ^ fl Wock of me processing device 

evaluation process that evaluates each region as one of a of (his i,^,,^. 

binary region or a continuous tone region based on the ^ of „, ■ fr^^t 

plurality of characteristic amounts extracted by the charac- systemincocpara£ing me image processing device of FIG. 1; 

teristic amount extraction poms; and a region evaluadon embodi , 

correctioD process that corrects the evaluation results of the „ J£/^ ^ evaluation 4 rf processing 

region evaluation process, method of this invention; 

One preferred ernbodiment of the image processing sys- FIGS. 4a and 4B show (he block forming methods for 

tem of this invention comprises a density conversion means ^ $ rf ^ j^,^. 

forconvertingtoedensityofther^ FIGS. SA and SB shoT specific examples of the two 

image, a characteristic amount extraction means for extract- 55 . . . , ... . 

u^a plurality of crun^cteristic amounts contained by the charactensuc amounts of this invention; 

injut Lge. a region evaluation means for evaluating each HOS; «A and 6B graphically show the region evaluauon 

region as one of the binary region or the continuous tone states of this invention; 

region on the basis of the plurality of characteristic amounts FIG. 7 is a block diagram of a first preferred embodiment 
extracted by the characteristic amount extraction means, and M of the region evaluation subsystem; 
a signal selection means for switching between binary FIG. 8 is a block diagram of a first preferred ernbodiment 
output image signals generated by either the binary conver- of the continuous tone processing subsystem of FIG. 1; 
sion process or the continuous tone conversion process FIG. 9 graphically shows an example of a gamma- 
based on the evaluation results of the region evaluation correction curve used in the continuous tone processing 
means. 65 subsystem of FIG. 8; 

Another preferred embodiment of the image processing FIG. 10 shows an example of a weighing matrix used in 
system of this invention wmprises a density conversion the continuous tone processing subsystem of FIG. 8; 
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FIG. 11 is a block diagram of a first preferred embodiment preferred embodimeat of the region evaluation subsystem 

of the binary processing subsystem of FIG. 1; and the second preferred embodiment of the signal selection 

FIG. 12 is a flow chart outlining a second preferred subsystem. 

emb<>diment of the region evaluation step; DETAILED DESCRIPTION OF PREFERRED 

FIG. 13 shows a first preferred embodiment of the refer- EMBODIMENTS 
ence blocks or reference pixels for the region correction step 

of FIG 12* In the following preferred embodiments, the input images 

FIG. 14 shows examples of the patterns used in the pattern bka ^ **** P 01 * 005 ' such as chafers or line 

..... c a mjc a u^- the input images, the input image signals have 256 different 

FIG. 15 is a block diagram of a second preferred embodi- levels (0-255). where white is indicated by a density 

ment of the region evaluation subsystem; q{ 255 and bkck u mdicatcd by a valuc of 0 . 

FIG. 16 is a block diagram of a first embodiment of the ^ ^ e ou tpul images, the binary output signals have density 

region correction device of FIG. IS; lcvc i s 0 f e i mer o or 1. where white is indicated by a density 

FIG. 17 is a block diagram of a second preferred embodi- 15 value of 1 and black is indicated by a density value of 0. 

ment of the region correction device of FIG. 15; As snown j n fig. 1. the image processing system 160 of 

FIG. 18 shows in greater detail the multi-input AND gates this invention comprises an image signal switching sub- 

of FIG. 17 ; system 100 A and a density conversion subsystem 100B. The 

FIG. 19 is a block diagram of a second preferred embodi- image signal switching subsystem 100A includes a region 

ment of the continuous tone processing subsystem; evaluation subsystem 101 and a signal selection subsystem 

FIG. 20 is a block diagram of a second preferred embodi- ^2 THe density conversion subsystem 100B comprises a 

f L L ^ . „ continuous tone image processing subsystem 103 and a 

ment of the binary processing subsystem, ^.JLg^bs^ 1M, A. shown inHG. 

FIGS. 21Aand 21B illustrate a second preferred embodi- j ^ ^ ^ coliSmm$ tone /binary 

ment of the region correcting step of FIG. 12; 25 h inpm oQ signaJ Unc 107 simultaneously to the 

FIG. 22 is a block diagram of a third preferred embodi- re gion evaluation subsystem 101. the continuous tone image 

ment of region correction device of FIG. 15; process subsystem 103 and the binary image processing 

FIG. 23 is a flow chart outlining the first preferred subsystem 104. 

embodiment of the region evaluation process used with a ^ j^e region evaluation subsystem 101 evaluates whether 

first preferred embodiment of the signal selection process; me curre nt portion of the mixed continuous tone/binary 

FIG. 24 is a block diagram of a third preferred embodi- input image is a binary region, such as characters, diagrams 

ment of the image processing system comprising the first and other line art* or is a continuous tone region, such as 

pref erred embodiment of the region evaluation subsystem photographs and half-tone dots. The results of the evaluation 

and a first preferred emrx>diment of the signal selection 35 are output by the region evaluation subsystem 101 to the 

subsystem; signal selection subsystem 102. The signal selection sub- 

FIG 25 illustrates the selection of the 4-block region used system 102 selects which one of the binary signals output by 

by the signal selection subsystem of FIG. 24; the continuous tone image processing subsystem 103 and the 

FIG. 26 illustrates the inputs to the switching unit of the «^™* F*?™* ?*T u ™w Z 

* , . , A , . one or more of a storage system, a communication system. 

RG. 27 is a flow chart outlining the first preferred or , p^^o/shown). 

emb0 f nel ? "J" r ^,° n "T^T ^LSSlri,! In addition, the region evaluation subsystem 101 further 

second preferred embodiment of the signal selection pro- , , 6 , , ^ * 

H V1UWW & 45 analyzes half-tone regions to determine whether they should 

■ „. r r ^ ~* a be evaluated as a binary region or a continuous tone region. 

FIG. 28 is a block diagram of a fourth F eferred embodi- ^ evamatioo is bascd on ^ numbcr 0 f half-tone lines in 

ment of the image processing system comprising tiie first half . tonc reg i 0 n. For example, in a preferred 

preferred embodiment of the region evaluation subsystem ^ lementatioiK when me ^ohmon of the mixed continu- 

and a second preferred erd>odiroent of the signal selection ^ input i^ge is 300 dots per inch (dpi), 

subsystem; a ^40^ re gion having over 100 lines per inch is evaluated 

FIG. 29 illustrates the inputs to the switching unit of the as a ^^^^5 tonc t( >pon, while a half-tone region with 

signal selection subsystem of FIG. 28 for a 16-pixel block; ^ |j QCS OT less j s evaluated as a binary region. In 

FIG. 30 is a flow chart outlining the second preferred addition, if the resolution of the input image is 200 dpi, a 

embodiment of the region evaluation process used with the 5J half-tone region having over 50 lines per inch is evaluated 

first preferred embodiment of the signal selection process; as a continuous tone region, while a half-tone region having 

FIG. 31 is a block diagram of a fifth preferred embodi- 50 lines or less per inch is evaluated as a binary region, 

ment of the image processing system comprising the second ^ described above, the current input image portion input 

preferred eriibodiment of the region evaluation subsystem on signal line 107 is simultaneously input to the continuous 

and the first preferred embodiment of the signal selection ^ tonc image processing subsystem 103 and the binary image 

subsystem; processing subsystem 104 of the density conversion system 

FIG. 32 is a flow chart outlining the second preferred 10OB. The continuous tone image processing subsystem 103 

embodiment of the region evaluation step used with the converts the current portion of the mixed continuous tone/ 

second preferred embodiment of the signal selection step; binary input image into a binary output image portion to be 

and 65 output on the signal line 106 using a continuous-tone-to- 

FIG. 33 is a block diagram of a sixth preferred embodi- binary conversion method that is appropriate for continuous 

ment of the image processing system comprising the second tone regions (hereinafter 'the continuous tone conversion 



06/30/2004, EAST version: 1.4.1 



5.784,488 

7 8 

process"). Similarly, the binary image processing subsystem each region of the input image into a binary output image 

104 converts the current portion of the mixed continuous using the binary conversion process, which is appropriate 

tone/binary input image into a binary output image portion for the binary regions of the input image, 

to be output on the signal line 106 using a binary-to-binary Furthermore, one of the binary images created by the 

conversion method that is appropriate for binary regions s continuous tone image processing subsystem 103 and the 

(hereinafter "the binary conversion process"). binary image processing subsystem 104 is selected by the 

It should be appreciated that both the continuous tone signal selection subsystem 102 and is output to the signal 

image processing subsystem 103 and the binary image output means 1*5. The binary output image signal is output 

processing subsystem 104 convert the current portion of the from the signal output means 105 to communication circuits 

input image each time. Accordingly, for one of the continu- 10 or a memory via an image output means 204. to an image 

ous tone image processing subsystem 103 or the binary display system 205. such as a CRT, or to an image printing 

image processing subsystem 104. the applied conversion system 206, such as a printer. 

method is inappropriate for the current portion of the input in the image processing system 100 shown in FIG. 2, the 

image, while the other conversion method is appropriate for region evaluation subsystem 101, the continuous tone image 

the current portion of the input image. The appropriately 15 processing subsystem 103. and the binary image processing 

converted output image is output on the signal line 106 by subsystem 104 are positioned so that the continuous tone 

appropriate control of the switch 108 by the signal selection conversion process and the binary conversion process are 

subsystem 102. That is. the converted output image signal performed in parallel, with one of the converted binary 

created by either the continuous tone image processing output signals being selected and output based on the results 

subsystem 103 or the binary image processing subsystem 20 0 f the region evaluation process. 

104 is selected and output on the signal line 106 by the signal pjQ 3 j s a flowchart outlining a first preferred embodi- 

selection subsystem 102 controlling the switch 108. mcnl 0 f ^ reg i on evaluation process S101. First in step 

In the image processing system 100 shown in FIG. 1. the S201. a mixed continuous tone and binary image, in which 

continuous tone image processing subsystem 103 and the the binary and continuous tone regions are intermixed, is 

binary image processing subsystem 104 operate in parallel. input Next in step S202, the input image is divided into 

One of the output image signals is selected based on the blocks which arc M pixels wide and N pixels high, where M 

evaluation results from the region evaluation subsystem 101. and N are positive integers. Then, in step S203, density 

It would also be appropriate to perform the region evaluation conversion of the input image signal is performed on a 

process first and selectively perform only the appropriate pixel-by-pixel basis. Next in step S204, the number of black 

one of the continuous tone processing or the binary pro- pixels is counted for each block, while at the same time, in 

cessing based on the evaluation results. In this case, the step S205, the maximum density difference is determined for 

signal selection subsystem 102 would directly control the each block- Then, in step S206, for each block an evaluation 

operation of the continuous tone image processing sub- is performed to determine whether the block, if the evalu- 

system 103 and the binary image processing subsystem 104, ation is done on a block-by-block basis, or the center pixel 

rather than controlling the switch 108, which would then (target pixel) in each block, if the evaluation is done on a 

generally not be needed. pixel-by-pixel basis, is a binary region or a continuous tone 

As shown in FIG. 2, an image signal having both con- region, 
tinuous tone portions (or regions) and binary portions (or Next, in step S207, a binary signal to be output is selected 
regions) is input to an image input system 110, for example, ^ based on the results of the evaluation step S206 for each 
by an image receiving system 201, such as a facsimile, a block. Thus, when processing each block, when the block is 
modem, or a network port, or by an image reading system evaluated as a binary region, a switching signal is output to 
202, such as a scanner. The signal read from the image select the binary output signal corresponding to the binary 
reading system 202 is first converted from analog to digital conversion process for all pixels in the block when the 
form. The digital signal output by the image reading system 45 evaluation is performed on a block-by-block basis, or for the 
202 is then input to a preprocessing system 203 that pre- center pixel when the evaluation is performed on a pixel- 
processes the digital signal to perform shading correction on by-pixel basis. In contrast, when the block is evaluated as a 
the image signal The preproccssed image signal is then continuous tone region, a switching signal is output to select 
output by the preprocessing system 203 to the image input the binary output signal corresponding to the continuous 
system 110. The image input system 110 then distributes the ^ tone conversion process for all pixels in the block when the 
input digital signal to the region evaluation subsystem 101, evaluation is performed on a block-by-block basis, or for the 
the continuous tone image processing subsystem 103 and the center pixel when the evaluation is performed on a pixel- 
binary image processing subsystem 104. by-pixel basis. 

The region evaluation subsystem 101 evaluates whether That is, when the evaluation is performed on a pixel-by- 

particular regions of the input image are binary regions, such 55 pixel basis, a switching signal is output for each pixel to 

as characters or drawings, or are continuous tone regions. select the binary output signal corresponding to either the 

such as photographs or half-tone dots. The signal selection binary conversion process or the continuous tone conversion 

subsystem 102 selects which converted binary signal, either process. Thus, it should be appreciated that the method for 

from the binary image processing subsystem 104 or from the dividing the blocks in step S202 differs when the region 

continuous tone image processing subsystem 103. to output # evaluation of step S206 is performed on a block-by-block 

based on the region evaluation results for each particular basis as when the region evaluation of step S206 is per- 

region. formed on a pixel-by-pixel basis. 

The continuous tone image processing subsystem 103 FIG. 4A illustrates the block evaluation method when the 

converts each region of the input image into a binary output evaluation is performed on a block-by-block basis. In this 
image using the continuous tone conversion process, which 65 case, the input image is divided simply into blocks which are 

is appropriate for the continuous tone region of the input M pixels wide and N pixels high. In FIG. 4A, M=5 and N=3. 

image. The binary image processing subsystem 104 converts The block of MxN pixels is referred to as the target block. 



06/30/2004, EAST version: 1.4.1 



5,784,488 

9 10 

The evaluation process is performed on each current block In contrast in FIG. 5B. all of the pixels have a density 

301. making the block adjacent to it the next target block level of either 7 or 8, as these pixels form a portion of a 

302 continuous tone region, such as a photograph. In general . the 

FIG. 4B illustrates the block evaluation method when the maximum density difference is small in the continuous tone 

evaluation process is performed on a pixel-by-pixel basis. In 5 region because density changes are gradual. TTie J 111 ^^ °* 

this case, a block is again M pixels wide and N pixels high. black pixels is great because there are few pads mat are 

In FIG. 4B. as in FIG. 4A, M=5 and N=3. The block is white in a contxnuous tone image. In FIG. SB. the number of 

centered around a target pixel 303. When the next pixel 304 black pixels, that is, the pixels having a density at most equal 

is processed, a new block (not shown), which is also M to the threshold value Tl of 11. is 18. and the rnaximum 

pixels wide and N pixels high, is formed and centered "> density difference is 1. 

around the next pixel 304. In the examples shown in FIGS. 5A and 5B, if the average 

As described above, the input image signal has 256 density is determined the same value would result for both 

possible density levels or gradations. Naturally, it is possible HG. 5A and FIG. 5B. making impossible any (Ustinction 

to process the signal in the 256 level form. However. between the binary and continuous tone regions. However, 

because only 16 density levels are sufficient for the region 15 in this invention, by using the number of black pixels, the 

evaluation process of this invention to operate correctly and resulting value differs greatly between i the two regions, 

efficiently, the number of density levels in the image signal making it possible to distinguish easily between me binary 

is preferably reduced from 256 to 16. In one preferred regions and the continuous tone regions of the mixed input 

embodiment of this reduction process, the value of the image. 

density level for each pixel is divided by 16, and rounded to 20 It should be appreciated that it would also be appropriate 

the nearest integer value. Thus, by conducting the density to determine the number of white pixels instead of the 

conversion of step S203, the size of the hardware can be number of black pixels. The number of white pixels is the 

reduced, it should also be appreciated that either step S202 total number of pixels in a block having an image density 

or step S203 can be performed first greater man the threshold value Tl. To find the number of 

Preferably, in this invention, the value of N ranges from 25 black pixels from Renumber of white pixels, tte number of 

1-5 and the value of M ranges from 4-20. The value of N white pixels is subtracted from the total number of pixels 

is limited only so that the hardware requirements for the M N in the block. When this process is formed by 

image memory can be reduced. Thus N can be any value hardware, me processes can be performed in parallel as 

su^rtablebymer^^ v, show * in FKJ5. 1 md X However, when this process is 

so that instances where both binary and continuous tone 30 performed by software, the processes must be performed 

regions occur within a single block are avoided or mini- serially, with either the maximum density difference deter- 

mized Furthermore, the total number of pixels in a block mining step S205 or the black pixel counting step S204 

(i.e., the value for (M N) is preferably &-40. in order to being performed first. 

reduce the amount of calculation and to reduce the size of 35 As described above, after the two characteristic amounts, 

the hardware. During experiments, block dimensions of i.e. the number of black pixels and the rnaximum density 

16x1, 8x2. 10x2 and 8x3 pixels yielded the best results. difference, have been extracted, the evaluation of step S206 

In step S204, the number of black pixels is the total to determine whether the target block is a binary region or 

number of pixels in the block having a reduced image * continuous tone region is performed 

density at most equal to the threshold value Tl. In the first 40 FIG. 6A illustrates one example of the evaluation condi- 

preferred enirxxliment, Tl is set to 11. The inventors have tions used to evaluate whether a block, or a pixel is a binary 

determined during experiments that, in general, the thresh- region or a continuous tone region. FIG. 6A shows the 

old value T 1 should be set at around Ya of the total number region evaluation conditions when the block size is 16 pixels 

of input density levels, in order to accurately count the by 1 pixel and the density has 16 gradations 0-15. In this 

number of black pixels without the black pixel count being 45 case, when both the maximum density difference of a block 

affected by the background color of the paper used in is at most equal to a threshold value T2 and the number of 

reproduction. Accordingly, in this first preferred black pixels is at least equal to a threshold value T3, the 

einbodiment, because the number of density levels is set at current block falls into area B of FIG. 6A. Otherwise, if 

16 through the density conversion step S203, the threshold either the niaximum density is above the threshold value T2 

value is set at 11. which generally corresponds to % of 16. 50 or the number of black pixels is below the threshold value 

In step S205, the niaximum density difference is the T3, then me ciirrentbl(>ck falls into are^Aof HG. 6A When 

difference betweea the maximum density and the minimum the block falls into area B, then the block, if the evaluation 

density among the pixels of each block. FIGS. 5A and SB « on a block-by-block basis, or die center pixel, if the 

show examples of possible density distributions in a block: evaluation is on a pixel-by-pixel basis, is evaluated as a 

In FIGS. 5A and SB. the block is 6 pixels wide and 3 pixels 55 continuous tone region or pixel. In contrast, when the block 

high. FIG. 5A shows an example of a binary region, while falls into area A. then the block, or pixel is evaluated as a 

FIG. 5B shows an example of a continuous tone region. In binary region or pixel. For this example, the results of 

FIG. 5A. the pixels having a density of 0 form a portion of experiments indicate tf^ optimum results can be obtained 

a binary image, such as a line or character. The pixels having bv setting TZ- 10 and T3-4. 

a density of 15 are blank (i.e.. white). In general, the 60 Another example of the region evaluation conditions is 

maximum density difference is large in the binary region illustrated in FIG. 6B. In this example, the conditions are not 

because the contrast between white and Wack pixels is determined by two straight lines, one vertical and one 

distinct. The number of black pixels is small because of the horizontal, as in the example shown in FIG. 6A. Rather, the 

large number of blank pixels in a binary image. In FIG. 5A. precision of the evaluation process is enhanced by using an 

the maximum density difference is 15 and the number of 65 inclined line x or a curved line y in place of the perpen- 

black pixels, that is, the pixels having a density at most equal dicular intersection of the horizontal and vertical lines of 

the threshold value Tl of 11. is 9. FIG. 6A. Thus, those blocks whose maximum difference 
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values and black pixel values would place them in areas C density difference ranges from 0 to 15. The number of black 

and D. if the inclined line x is used, or area C. if the curved pixels counted by the counter 60S and the maximum differ- 

line y is used will be evaluated in FIG. 6B as binary regions eoce value output by the differentiator 60S are input to a 

instead of continuous tone regions. In this invention, the region evaluation ROM 609. The region evaluation ROM 

thresholdvaluesT2andT3andtheshapeof thecurvey used 5 «•» °« 5-bit number-of-black-pixels value output by 

in the evaluation process are optimized based on the block «* »* * c ^ ma^un^denaty-difference 

ui uk cvaiuauuu v value output by the differentiator 608 to form the 9-bit input 

address. 

When the number of white pixels is used as a character- ^ ^ n . evaluation R0M m reg|on evaluation 

istic amount while it may be appropriate to calculate the results wtdcfa ^ ^ ^ characteristic amounts as the input 

number of black pixels, but the same results can be obtained W a(Uresses m ^ as indieated m eitnw nG 6A a nG> 

by replacing the 0 on the horizontal axis (number of black 6 „ since ^ re ^ on wataatioiI TO stored in the 

pixels) in FIGS. 6A and 6B with 16. and by replacing the 16 region evaluation R0M (#,. ratner ^ King calculated in 

0" real-time, very complex curves y can be used to divide area 

In this way, because the two characteristic amounts (i.e.. ^ A f rom aica b without increasing the complexity of the 

the number of black pixels and the maximum density system. From the values for the number of black pixels and 

difference) are used in the region evaluation step S206, the me maximum density difference, an evaluation signal is 

precision of the region evaluation process S101 is enhanced output from the region evaluation ROM 609 indicating 

compared to region evaluation methods which use only a whether this block, or the center pixel, is a binary region or 

single characteristic amount. In addition, because each of the a continuous tone region. Based on the evaluation signal, a 

characteristic amounts can be obtained through a simple binary output signal, corresponding to the block, or the 

process, only a short processing time is needed and the center pixel, and output from either the continuous tone 

hardware implementation can be accomplished without dif- image processing subsystem 103 on the signal line 612 or 

ficulty. the binary image processing subsystem 102 on the signal 

The first preferred embodiments of the specific hardware ^ line 613. is selected by the binary switching unit 610 to be 

structures of the major subsystems of the image processing output on the signal line 614 to a printer, a display or the like, 

device shown in FIGS. 1 and 2 will be described with in FIG. 7, the switching unit 610 corresponds to the signal 

reference to FIGS. 7 to 11. FIG. 7 shows the structure of the selection subsystem 102. 

region evaluation means 101 and the signal selection means ^ first preferred embodiment of the continuous tone 

102 shown in FIG. 2. As shown in FIG. 7. image data stored M image processing subsystem 103 shown in FIG. 2 is shown 

in an image memory 1 is scanned to locate each block of m greater detail in FIG. 8. In FIG. 8. the image memory 1 

MxN pixels. The scanned image data is then output on a outputs the current block being evaluated by the region 

block-by-block basis to a density converter 603. where the evaluation subsystem 101 to the continuous tone image 

density is converted from 256 density levels to 16 density processing subsystem 103. The current block is input to a 

levels, 3 5 garnma correction ROM 703 which stores a gamma correc- 

The density converter 603 outputs the block of density- tion table and which alters the density values for the pixels 

converted image data on a pixel-by-pixel basis to a com- of the current block. The gamma-corrected block is output 

parator 604. The comparator 604 compares the density level from the garnma correction ROM 703 on a pixel-by-pixel 

of each pixel of the block to the threshold value Tl. Based basis and undergoes the continuous tone conversion process 

on the results of the comparison, the comparator 604 outputs ^ using the so-called error diffusion method That is. as each 

signals to a counter 605. which counts 1 each time a black pixel of the current block is output to the differentiator 704. 

pixel is detected. Thus, the total number of black pixels in the density value f for a current pixel is corrected by adding 

the block is stored by the counter 605. to it the weighted error to form f . That is, f =f+WyE^ 

The pixel data output from the density converter 603 is Next the corrected density value f for the current pixel is 

also input to a maximum value detector 606 and a minimum 45 compared by a comparator 705 to a binary threshold value 

value detector 607. For each block, as each converted pixel input on signal line 709. The comparator 705 outputs, based 

is output from the density converter 603, the maximum on the comparison, a binary valued signal L That is, based 

value detector 606 detennines if the current pixel has a on the comparison, I is 0 or 1. The differentiator 706 

higher density value than the current ma ximum density determines the error E^, where Ey=I-f , and stores it in the 

value stored in the maximum value detector 606, and stores 50 error memory 707. The weighing device 708 performs a 

the density value of the current pixel if it is higher. Similarly. weighing process on the error stored in the error memory 

the imnimum value detector d^enrunes if the density value 707 using a weighted matrix W^. FIG. 10 shows one 

of the current pixel is lower than the current minimum preferred example of the weighted matrix Then, the 

density value stored in the imnimum value detector 607. and weighted error is fed back to the differentiator 704 to 

stores the density value of the current pixel if it is lower. The 55 be added to the garnma corrected density value of a next 

density difference is determined as the difference between pixel. 

the density values stored in the maximum and minimum The gamma correction provided by the gamma correction 

value detectors 606 and 607. That is. after the current block ROM 703 corrects the pixel density based on the attributes 

is completely output by the density converter 603. the of the output device (Le., the printer, the display or the like), 

minimum and maximum value detectors output a minimum & That is. when gamma correction is not provided, the density 

value and a maximum value for the current block to a information is not correctly evaluated for the output device 

differentiator 608. When all pixel data in the current block for the continuous tone images. 

has been scanned, the maximum density difference for the FIG. 9 shows one example of the gamma correction curve 

current block is output by the differentiator 608, (for laser printers) used in the image processing system 100 

In the example shown in FIG. 6A, the value for the 65 of this invention. In FIG. 9, the horizontal axis is the input 

number of black pixels ranges from 0 to M N, which is 18 image density leveL while the vertical axis is the corre- 

for the blocks shown in FIGS. 5A and 5B. and the maximum sponding garanw-corrected image density level. The gamma 
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curve used in the present invention has a non-sensitive rone and the evaluation results of step SU06 fox the surrounding 
Go of about 32 density levels on the black level side and a blocks or pixels. In this second preferred embodiment, the 
non-sensitive zone Gw of about 64 density levels on the attribute for the target block or pixel is the binary or 
white level side. This gamma correction scheme is used to continuous tone region assigned to the block or pixel result- 
keep errors from standing out in the processed image when 5 ing from the region evaluation on each block or each pixel 
binary regions are erroneously evaluated as continuous tone of step S1106. 

regions by the region evaluation subsystem 101. When a The region correction process of step S1107 is illustrated 

gamma correction curve such as the one shown in FIG. 9 is ^ FIGS. 13 and 14. In FIG. 13. the squares labelled 0-8 and 

used, the contrast between white and black is distinct and a represent blocks or pixels. That is. when the region 

good image quality is obtained, even if part of a character 10 evaluation process of FIG. 12 is performed on a block-by- 

erroneously undergoes the continuous tone conversion pro- block basis, the squares represent blocks, and when the 

cess to generate the binary output Naturally, when the process is performed on a pixel-by-pixel basis, the squares 

gamma curve shown in FIG. 9 is used, the quality of the gray represent pixels. Thus, the basic steps in the process are the 

scale in the continuous tone regions deteriorates somewhat same, regardless of whether the process is accomplished for 

but this is not a problem, because, in most every actual 15 cacn block or for each pixel. The following description 

continuous tone image, there are essentially no image areas assumes, for ease of illustration, that the process is per- 

that are either completely Wack or completely white. formed on a block-by-block basis. In FIG. 13. the block 

FIG. 8 shows a continuous tone image processing sub- labelled 0 is the target block, which is the object of the 

system 103 which uses the error diffusion method However, correction process. Thus, blocks 1-8 are reference blocks, 

it is also possible for the continuous tone image processing 20 FIG. 14 shows one preferred example of the attribute 

subsystem 103 to use a dither method which converts the patterns used in the correction process of step S1107. In FIG. 

continuous tone regions to the binary output using a thresh- 14, the block indicated by the arrow labeled a is the target 

old value which periodically changes. block, t indicates that the block attribute indicates a binary 

FIG. 11 shows a first preferred embodiment of the binary region, p indicates that the block attribute indicates a con- 
image processing subsystem 104 shown in FIG. 2. As shown 25 tinuous tone region, and * indicates a don't care condition, 
in FIG. 11, the image memory 1 outputs the current block in that the block can be either a binary region or a continuous 
being evaluated by the region evaluation subsystem 101 to tone region. 

the binary image processing subsystem 104. The block The block attributes matching the patterns shown in 

output by toe image memory 1 is input on a pixel-by-pixel examples A-D of FIG. 14 are corrected to the patterns 

basis to a comparator 1004. The comparator 1004 compares indicated by examples A'-D', using only the reference 

a density level of each pixel to a binary threshold value input blocks present in the row of blocks that is currently being 

on signal line 1001. Based on the comparison, the compara- processed (Le. reference blocks 1-5 of FIG. 13). For 

tor 1004 outputs a binary output signal. That is, based on the example, assume a region evaluation result matches the 

comparison, the binary output signal is either 0 or 1. ^ pattern shown in example A. In this case, only the target 

In the present example, the threshold value input on signal block has been evaluated as a continuous tone region p, 

line 1001 is held constant In particular, the threshold value despite the fact that all of the surrounding reference blocks 

is set to 128 when there are 256 density levels and white is of the current row have been evaluated as binary regions t 

density level 255. However, the binary output signal can be Therefore, this continuous tone evaluation for the target 

created using various well-known methods, such as using ^ block is considered to be an error, and the evaluation is 

the average density of the current block as the binary corrected to indicate this block is a binary region t. as shown 

threshold value input on signal line 1001. in example A\ The correction patterns A-D correct errors in 

FIG. 12 shows a flowchart outlining a second preferred at 01051 two blocks * 

embodiment of the region evaluation process. First after the In addition, when using the reference blocks provided in 

multi-scale image, in which binary and continuous tone 45 the row of blocks currently being processed (reference 

regions are intermixed is input in step S1101, in step S1102. blocks 1-5) and the row of blocks already processed (blocks 

the image is divided into blocks which are M pixels wide 6-8)* the block attributes matching the patterns shown in 

and N pixels high. Next, in step S1103. the input multiple- examples E-J are corrected to the patterns indicated by 

density-level image is density converted. Then, for each examples E'-T. In the corrected patterns of examples F-T , 

block, in step S1104. the number of black pixels is counted, « it is possible to correct consecutive errors in no more than 3 

while in step S1105. the maximum density difference is blocks. 

determined After the two characteristic amounts, which are In this example, attribute correction is accomplished only 

the number of black pixels and the maximum density on the target block (the block indicated by the arrow labeled 

difference, have been extracted for each block, step S1106 is a. However, when blocks matching the pattern in example 

executed. In step SU06. when processing the image on a 55 B. far example, are corrected so that one of the two blocks 

block-by-block basis, an evaluation is made to determine evaluated as continuous tone region p is not corrected to be 

whether each block is a binary region or is a continuous tone a binary region t as in example B (as indicated by the arrow 

region. In step S1106, when processing the image on a labeled f$ in example B), when the target block is shifted one 

pixel-by-pixel basis, an evaluation is made to determine block to the right in the next correction pass, this block will 

whether the center pixel in each block is a binary region or ^ 06 corrected because the pattern row now matches example 

is a continuous tone region. Thus, steps S1101 to S1106 of A Therefore, it is not necessary to correct this block in the 

this second preferred embodiment are the same as steps first pass. The corrected patterns are set so as to statistically 

S201 to S206 of the first preferred embodiment so a further locate all errors in patterns when the region evaluation 

detailed description of these steps is omitted. process is accomplished on various images. 

Following the region evaluation step S1106. step SU07 is 65 After the region correction step S1107 has been 
executed. In step S1107, region correction is performed completed, step S1108 is executed. In step S1108. a switch- 
based on the attributes of the target block or the target pixel ing signal is output to select the binary output signal 
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corresponding to the attribute of the block. In other words. pattern does not match one of the patterns A-J shown in FIG. 

when the block is evaluated to be a binary region, a binary 14. the attributes prior to and after overwriting are the same, 

signal converted by the binary conversion process is selected However, in order to keep the structure of the hardware 

and output, and when the block is evaluated as being a simple, overwriting is always accomplished regardless of 

continuous tone region, a binary signal converted by the 5 whether or not the attribute has been corrected. Accordingly, 

continuous tone conversion process is selected and output. in FIG. 13, the region correction process is based on already 

In general, when a document image is processed, the corrected blocks 4-8. and uncorrected blocks 1-3. 

process is performed on the document from left to right in FIG. 16 shows in greater detail a first preferred embodi- 

the first processing direction shown in FIG. 13. and is thus ment of the region correction device 1402 and a first 

accomplished on each line or row of blocks, and after 10 preferred embodiment of the region attribute memory 1401. 

processing each line or row of blocks, the system moves to In this first preferred embodiment, the region correction 

the next line or row of blocks in the 2nd processing device 1402 is simply a region correction ROM 1409. As 

direction. Accordingly, when region correction is performed shown, in FIG. 16, the region evaluation results for the 

on the reference blocks shown in FIG. 13, it is necessary that current block or pixel of the current row 621 evaluated by 

the characteristic amount extraction and region evaluation 15 the region evaluation ROM 609 are stored in the location 

processing on at least block 3 of FIG. 13 has been com- indicated by "A* 1 in the region attribute memory 1401. 

pleted. When these processes are performed in parallel, the Furthermore, when the target block or target pixel is 0 and 

characteristic amount extraction and the region evaluation reference blocks or reference pixels are blocks or pixels 1-8, 

processes are performed on block A, while the region signals are sent to the region correction ROM 1409 using the 

correction process is performed on block 0. 20 attributes of the blocks or pixels 0-8 as input addresses for 

Thus, by correcting the region evaluation of a block or the region correction ROM 1409. The region correction 

pixel based on the attributes of the surrounding blocks or ROM 1409 stores a table which outputs the attributes of the 

pixels, it is possible to boost the precision of the region target block or target pixel 0 based on the pattern formed by 

evaluation process. me attributes of blocks 01 ^ ch °-» 35 mc mput address ' 

ttt^ i c u f -a .mjw*wn» «f 25 When this pattern matches one of the patterns A-J shown in 

FIG. IS shows second ^^ c ^ mb ^^^ f * e FIG. 14, a rignal which overwrites *e attribute of target 

region evaluation subsystem 101 of FIGS. 1 and 2. In FIG. * ^ 

15. the image memory 1 through the region evaluation ROM , ^ . t . ^ 

xj. ure uuagt m ~7y "♦™f < ^^^K rt Hi- m ^nt c ^wn memory 1401. The overwrite output from the region cor- 

609 are the same as in the first preferred embodiment shown . .„~a Jul »«™t ui^v a t n 

in FIG. 7. Thus, any further description of these elements is „ rc «"> n *>M 1409 m ^^ in £* C £ 

omitted. The description which follows will focus on the 30 attribute memory 1401. Thus, if the attribute of die 

JT , ^ 1/1A1 . - rtn / , rtW( , h - n target block 0 has been, for example, erroneously evaluated 

region attribute memory 1401 and the region correction * ^ T/i ^ Qc w 

device 1402 of this second preferred embodiment as 1 • lt 13 overwritten as "0. 

The region attribute memory 1401 stores the attributes of output J fr ° m co ^ on R ™ 

the blocfc or pixels necessary for the region correction 35 1409 » f * ^VT* 

process, the memory storing attribute. /die lowttlcf W - the signal hue 611 to the binary switching run* 

blocks which are currently being processed and the "^Jf ' f ^trxit from toe region con^cUon ROM 

attributes of the row 620 of blocks which have already been » 0- mc # ^ ^ « mc ?W* ^ e « 12 *™ * c 

processed, as shown in FIG. 13. Naturally, when the row 620 continuous one image Processing subsystem 103 is 

of blocks which have already been processed is not referred «, ? output from the region correction 

to, it is appropriate to store just tk ^attributes of the neces- *° ROM 1409 is 1, the binary output on the ^8°^ 

sary number of blocks or pixels in the row 621 of blocks * e Wnar > processing subsystem 104 is selected, 

currently being processed The region correction device In FIG. 16. the region correction device 1402 is the region 

1402 outputs the corrected attribute of the target block or correction ROM 1409. However, region correction device 

target pixel 0 based on the attributes of blocks or pixels 0-8. 45 1402 is not limited to a region correction ROM 1409, and 

when the reference blocks or reference pixels shown in FIG. may alternatively be accomplished by a connecting circuit 

13 are 1-8. The attribute of a binary region is 1 and the as shown in FIGS. 17 and 18, 

attribute of a continuous tone region is 0. Thus, the target FIG. 17 shows a second preferred embodiment of the 

and reference blocks 0-8 provide 9 bits, for 512 possible region correction device 1402 of FIG. 15. As shown in FIG. 

input states. For each of the 512 input states, either a binary ^ 17, a connecting circuit 1410 selectively connects the 

region attribute 1 or a continuous tone region attribute 0 is attribute outputs of the target block or pixel and the refer- 

output The patterns A-J shown in FIG. 14 are included in ence blocks or reference pixels retained in the region 

these 5 12 possible states, and when the pattern matches one attribute memory 1401 as outlined below. A pattern match- 

of these patterns A-J. the attribute of the target block or pixel ing circuit 1404 determines whether or not the block or pixel 

is corrected. 33 attributes of blocks or pixels 0-8 match one of the patterns 

The output of the region correction device 1402 is input A-J shown in FIG. 14. In the pattern matching circuit 1404. 

to the binary signal switching unit 610 and a binary signal one pattern niatching circuit device 1404z is required for 

corresponding to the corrected evaluated attribute for the each pattern Z to be matched against In this embodiment 

current block or pixel, is output In other words, when since patterns A-J are used to correct the region evaluation 

processing is performed on each block, a binary output & attributes, the pattern rnatching circuit 1404 comprises the 

signal converted by a binary conversion process is selected pattern matching circuits components 1404a-1404/. 

when the block is a binary region, and a binary output signal fig. 18 shows one embodiment for the pattern matching 

converted by a continuous tone conversion process is circuit component 1404a corresponding to partem A. The 

selected when the block is a continuous tone region connecting circuit 1410 shown in FIG. 17 selectively con- 

The output of the region correction device 1402 is also fed 65 nects the outputs of the target and reference blocks or pixels 

back to the region attribute memory 1401 to overwrite the 0-8 to the pattern matching circuit components 

attribute of the target block or target pixel 0. When the input 14043-1404/. Thus, as shown in FIG. 18. the connecting 



06/30/2004, EAST Version: 1.4.1 



5,784488 

17 18 

circuit 1410 connects the attributes of reference blocks 1. 2, device 1402 for that same block or pixel in the second 

4 and 5 directly to the AND gate 1408 of the pattern preferred embodiment of the region evaluation subsystem 

matching circuit component 1404a. The attribute of the 101 shown in FIG. IS. the delay circuit 2 temporarily stores 

target block 0 is connected to the AND gate 1408 via the and then synchronizes the image signal read from the image 

inverter 1407. Therefore, the output of the pattern matching 5 memory 1, so that the corresponding binary output signal for 

circuit component 1404c is 1 only when the input pattern that same block or pixel is selected only after region 

matches pattern A shown in FIG. 14. That is. when the correction has been completed on that same block or pixeL 

attribute of the target block 0 is 0 and the attributes of the It is also acceptable to insert a reading regulating circuit in 

surrounding reference blocks 1. 2. 4 and S are 1, pattern A place of the delay circuit 2 and to regulate the timing of the 

of FIG. 14 is matched. Thus, when these signals are trans- 10 reading of the image signal from the image memory 1 to 

mitted to the pattern matching circuit component 1404a. the synchronize the binary outputs of the continuous tone image 

output of the pattern matching circuit component 1404c is 1. processing subsystem 103 and the binary image processing 

The connecting circuit 1410 selectively connects the target subsystem 104 with the region evaluation subsystem 101. 

and reference blocks 0-8 attributes to the proper ones of the An alternate method for the region correcting procedure 

pattern matching circuit component 1404o-1404y. Since the 15 0 f gep S1107 is shown in FIGS. 21A and 21B. The method 

pattern matching circuit components 1404a- 1404/ corre- outlined in FIGS. 21A and 2 IB is a majority deterrnining 

spond to the patterns A-J in FIG. 14. the number of inverters method which determines the frequency of appearance of 

1407 and the insertion positions of the circuits varies for the attributes in the target block and the reference blocks or 

each of the pattern matching circuit components the target pixel and reference pixels, and selects the most 

1404a-1404y. 20 frequently appearing attribute as the attribute of the target 

In FIG. 17. the OR gate 1405 outputs the logical OR of the block or target pixel. In FIG. 21A. only the row 621 

outputs of the pattern matching circuit components currently being processed is used to provide the reference 

1404*3-1404/ Thus, when one or more of the patterns A-J blocks or pixels. In FIG. 21A. the two blocks or pixels 

is matched, the OR gate 1405 outputs a 1. The output of the positioned before the target block or pixel and the two 

OR gate 1405 and the evaluation attribute of the target block 25 blocks or pixels positioned after the target block or pixel in 

or pixel are input to an exclusive OR (XOR) gate 1406 mat the current row 621 are used as the reference blocks or 

outputs the exclusive logical sura of the output from the OR pixels. The attribute most frequently appearing in these five 

gate 1405 and the attribute of the target block or target pixel blocks or five pixels is used as the attribute for the target 

0. Thus, when the output of the OR gate 1405 is 1, the block or target pixel In FIG. 21B, both the row 621 

attribute of the target block or target pixel 0 is reversed. For ^ currently being processed and the last row 620 just com- 

example, if the input pattern matches pattern A, a 1 is output pleted are used to provide the reference blocks or pixels. In 

from the pattern matching circuit component 1404c and is FIG. 2 IB. the same 5 blocks or pixels are used as in FIG. 

input to the XOR gate 1406 via the OR gate 1405. The 21A, plus the 5 blocks or pixels in the last row 620 which 

attribute of the target block or target pixel 0, which is 0 are edge-wise adjacent to the 5 blocks or pixels of the 

because the target block has been erroneously determined to 35 current row 621 are also used as the reference blocks or 

be a continuous tone region, is also input to the XOR gate pixels. Thus, the attribute of the majority of the ten blocks 

1406. Thus, a 1 is output from the XOR gate 1406 on the or ten pixels is used as the attribute of the target block or 

signal line 615 and thus is written into the region attribute target pixel. 

memory 1401 as the corrected attribute of the target block or The majority deterrnining method has a disadvantage 

target pixel 0, overwriting the current incorrect target block 40 relative to the pattern matching method shown in FIGS. 13 

or target pixel attribute of 0. The output from the XOR gate and 14. in that, since the attribute appearance or pattern is 

1406 is also transmitted on the signal line 611 to the binary no t analyzed, the certainty of the correction slightly 

switching unit 610. decreases. However, the majority determination method has 

In this second preferred enujodiraent, the attribute of the an advantage, in that the complexity of the procedure does 

target block or target pixel is continually updated, but the 45 not increase even if the number of reference blocks 

region correction device 1402 may be designed such that the increases. Thus, when the number of reference blocks is 

attribute is updated only when the output of the OR gate large, the majority toermining method is preferable over the 

1405 is 1. pattern matching method. 

FIGS. 19 and 20 show second preferred embodiments of FIG. 22 shows a third preferred embodiment of the region 

the continuous tone image processing subsystem 103 and the 50 correction device 1402 of FIG. 15. In FIG. 22. the region 

binary image processing subsystem 104. In general, these evaluation ROM 609 and the region attribute memory 1401 

second embodiments include the same elements and rune- are the same as shown in FIG. 15. In FIG. 22, the region 

tional connections as the first preference enuxxliments correction device 1402 includes a counter 1901. which reads 

shown in FIGS. 8 and 11, respectively. In the second in the attribute for each block or pixel from the region 

preferred embodiments shown in FIG. 19 and FIG. 20. the 55 attribute memory 1401 and determines the number of 

only difference from the first preferred embodiments shown appearances of either the binary attribute or the continuous 

in FIGS. 8 and 11 is that a delay circuit 2 is inserted between tone attribute. Thus, for FIGS. 21 A and 2 IB. the calculated 

the image memory 1 and the gamma correction ROM 703 of value ranges from 0-5 or 0-10. respectively, because the 

the continuous tone image processing subsystem 103 shown number of blocks is five or 10, respectively. This determined 

in FIG. 19. and between the image memory 1 and the 60 value is input to a comparator 1902. where it is compared 

comparator 1004 of the binary image processing subsystem with a threshold value input on the signal line 618. For 

104 shown in FIG. 20. Most efficiently, the same delay 2 is FIGS. 21A and 21B the preferred threshold value is 3 and 6. 

used to supply the delayed block to both the gamma cor- respectively. The output of the comparator is thus the 

rection ROM 703 and the comparator 1004. corrected attribute, and is input to the attribute memory 1401 

Since a 4-biock or 4-pixel delay exists between the region 65 on the signal line 615. When the determined value of the 

evaluation by the region evaluation ROM 609 for a block or selected attribute (either binary or continuous tone) is 

pixel and the region correction by the region correction greater than the threshold value, the attribute of the target 
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block or pixel is set to the selected attribute. When the first preferred embodiment of the signal selection subsystem 

determined value is less than the threshold value, the 102. In FIG. 24. the image memory 1 through the region 

attribute is taken as the non-selected attribute (either con- evaluation ROM 669 are the same as shown in FIG. 7. As in 

tinuous tone or binary). The output from the comparator the second embodiment shown in FIG. IS. the region 

1902 is also output as the selection signal, which is trans- 5 evaluation result for the current block being evaluated by the 

mitted to the binary signal switching unit 610 on the signal region evaluation ROM 609 is stored in area Y of the region 

line (11, attribute memory 1401. In the region attribute memory 

In the second preferred embodiment of the region evalu- "M- *« tar 8« block 0 is surrounded by the reference 

ation subsystem 101 shown in FIG. 15 and the method Wocks 1-3 X_Y 

shown in FIG. 12. the region evaluation accuracy can be 10 The signal selecting subsystem 102 includes a state tran- 

further improved because incorrect region evaluations are sition detecting circuit 2101. an attribute pattern ROM 2102. 

corrected based on the attributes of the surrounding blocks a timing generator 2103. and a switching unit 2104. The 

after it has been determined whether or not the region is a state transition detecting circuit 2101 detects if the target 

binary region or a continuous tone region. block attribute has changed, and includes two XOR gates 

In general, when evaluations are carried out for each 15 "05 and 2106 and an OR g^e 2107. which ^outputs fte 

block, since inappropriately converted binary images end up logical OR of the output from the XOR gates 2105 and210* 

being output for entire blocks which are erroneously The XOR gate 2105 is connected to the reference block X 

evaluated/the errors have a tendency to stand out. In and the target block 0 of the region attribute memory 1401. 

particular, when the state changes from a binary region to a ^ white the XOR gate 2106is connected to ftereference block 

continuous tone region, or from a continuous tone region to 20 1 and the target block 0. The XOR gates 2105 and 2106 each 

a binary region, errors on the transition boundaries stand out output a 1 only when the values are different for Uie blocks 

„ , . ... . , _. _ .,.„„„•„.. X and 0. and the blocks 1 and 0. respectively, which 

In third preferred embodiments of the region evaluahon £ > 

method and subsystem 101. Mocks in which state transihon g£ 2105 ^ 2106 m eamtaeA t0 J 0R ^ 

^^^^"f^^I^iZSiZXi 25 2107.ll,eoutputoftheORgate2107isinput.omeco 1 Srol 

outlining a third prefened embodiment, comprising the first ^switching unit 2104. The attribute signal of 

prefenedenAodimentof ti^onevaluaaonproce» S101 ^ andX-Yis 1 for the binary region attribute 

S201^S206 of the first prefers embcxIimeDt shownin FIG. „ The attribute pattern ROM 2102 inputs the afiributes of 

3 Accordingly, a detailed description of these steps is 30 the target block 0 and the reference blocks 1-3 as input 

omitted. However, step S207 of the first preferred erabodi- addresses, and outputs patterns based on the input attribute 

ment shown in FIG. 3 has been replaced with the signal values. The timing generator 2103 generates a switching 

selecting processS102 shown in the third preferred embodi- signal based on the output of the attribute pattern ROM 

ment shown in FIG 23 « 2102 - ^ Etching signal is output to the B input of the 

In the signal selecting process S102, in step S20*7. the * 21W ^ e the atn^ute value of the target 

attribute of the target blockTchecked to determine if the *lock » » °*P ut * * c »P* of * e ™ X 2 ™ 

state of the evaluation attribute, relative to either laterally When a state transition has not occurred between either 

adjacent block, has changed from binary region to continu- the blocks 1 and 0. or between the blocks X and 0, the output 
ous tone region, or from continuous tone region to binary ^ of the OR gate 2107 is 0. In response to a 0 on the control 

region, or in other words, whether or not the state has input SL the switching unit 2104 selects the A input The 

changed. If, in step S2007. it is determined that the state has switching unit 2104 thus selects and transmits the region 

changed, the attributes of the surrounding blocks for which evaluation result from the region evaluation ROM 609 for 

the evaluation procedure has been completed are compared the target block 0 to the signal line 611. When a state 
in step S2008. That is, in step S2008. the frequency of 45 transition has occurred between either or both of the sets of 

appearance of the binary region attribute and the continuous blocks 0 and 1, or blocks 0 and X, the output of the OR gate 

tone region attribute among the attributes of the reference 2107 is 1. In response to a 1 on the control input SL the 

blocks and the target block are compared. Then, in step switching unit 2104 selects the B input The switching unit 

S2009, a switching timing is generated for the binary output 2104 thus selects and transmits the switching signal from the 
within the target block. In step S2010. when a state transition „ timing generator 2103 to the signal line 611. 

has thus occurred, the selection of the binary output signal In other words, when a state transition has not occurred, 

within the block is changed and the binary output signals are the input A, corresponding to the region evaluation result 

selectively output by the switching timing. That is, the from the region evaluation ROM 609 for the target block 0. 

output source for the output signal for the target block is is connected by the switching unit 2104 to the binary signal 
altered, as the output signal is output. In the previous 55 switching unit 610 by the signal line 611. When a state 

embodiments, once the output source is selected for a target transition has occurred, the input B, generated by the timing 

block, that source is used for all the pixels of that block. In generator 2103 based on the output of the attribute pattern 

contrast in this third preferred embcrfiment. the output ROM 2102. is connected to the binary signal switching unit 

source selected during the signal selection process S102 is 610 by the signal line 611. 

changed for some of the pixels of the target block. ^ pjQ 25 shows the region evaluation results for two rows 

Conversely, if it is detennined in step S2007 that no state 0 f blocks 620 and 621. The region evaluation procedure is 

transition exists in the target block, control jumps directly to completed for row 620. while the region evaluation proce- 

step S2010. where the switching signal is output based on dure is in process for row 621. In FIG. 25. each block 

the region evaluation result from step S2006. comprises 16 pixels in the horizontal row (i.e. M-16) and an 
FIG. 24 shows a third preferred eriibodiment of the image 65 indeterminant number of rows n. In FIG. 25, t indicates that 

processing system 100, comprising the first preferred the entire block has been determined to be a binary region 

eiribodiment of the region evaluation subsystem 101 and a block, while p indicates that the entire block has been 
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determined to be a continuous tone region block. The block procedure will be accomplished for correctly evaluated 

indicated by the arrow a is the target block 0. In FIG. 25, the blocks, but these errors will not stand out noticeably in the 

target block 0. which should have been determined to be a output binary images. 

continuous tone region p. has been erroneously determined The continuous tone image processing subsystem 103 and 

to be a binary region L 5 the binary image processing subsystem 104 connected to the 

When the attributes of the target block and the reference first preferred enabodiment of the region evaluation sub- 
blocks, as shown in FIG. 25 by the dotted line and in part (a) system 101 and the first preferred embodiment of the signal 
of FIG. 26. are transmitted to the attribute pattern ROM selection subsystem 102 in this third preferred embodirnent 
2102. the output pattern shown in part (b) of FIG. 26 is of the image processing system 100 are the same as those 
obtained. That is. in this example, the input to the attribute w shown in FIGS. 19 and 20. However, since the region 
pattern ROM 2102 is the attributes for the four blocks evaluation result is written into block Y and the binary 
surrounded by the dotted line in FIG. 25. Based on the output is selected for the target block 0. the delay interval of 
attributes of this 4-block portion, since three blocks have the delay circuit 2 is equivalent to a 2-block portion, 
been evaluated as being binary regions and only one has As described above, in this third embodiment of the image 
been evaluated as being a continuous tone region, an output 15 processing system 100 comprising the first preferred 
pattern of "1110" is obtained from the attribute pattern ROM embodiment of the region evaluation subsystem 101 and the 
2102. This output pattern considers the appearance fre- first preferred embodiment of the signal selection subsystem 
quency of each attribute and the attribute pattern of the 102, a ^termination is made, based on the maximum 
block, and is formed so as to preserve attribute continuity. density difference and the number of black pixels, whether 

In FIG. 25. considering the five horizontally aligned units 20 or not the target block is a continuous tone region. State 

as a single block, the second and third blocks from the left transitions of the region attribute are then detected between 

are taken as boundaries. Thus, the left side of the resulting the target blocks and the immediately adjacent blocks of the 

block, as shown in part (a) of FIG. 26. is a binary region for same row. When no state transition exists, the binary output 

characters or the like, and the right side is the continuous is selected based upon the region evaluation result When a 

tone region for a photograph or the like. If. instead, the 25 state transition exists, the region attributes of the target and 

output pattern is taken to be "0111", because, in FIG. 25. the surrounding blocks are compared, to selectively switch 

left side is a binary region and the right side is a continuous between the two binary output signals within the target 

tone region, the error stands out noticeably because a block. Thus, ultimately, the error of a binary image that has 

continuous tone region exists on the left side, and the region been output does not stand out noticeably, 

no longer matches the surrounding attributes. Thus, at this 30 FIG. 27 outlines a flow chart of a fourth preferred 

point, the output "1110" is obtained from the attribute embodiment of the image processing system 100. corapris- 

pattern ROM 2102, as shown in part (b) of FIG. 26. ing the first preferred embodiment of the region evaluation 

The tuning generator 2103 which receives this pattern process S101 and a second preferred enibodiment of the 

"HUT outputs a switching signal to the B input of the signal selecting procedures S102. Since steps S2401-S2406 

switching unit 2104, as shown in part (d) of FIG. 26, based are the same as steps S201-S206 of the first-third pref erred 

on the described pattern "1110". corresponding to the embodiments of the region evaluation process S101. a 

4-pixel blocks of the 16 pixels which form each horizontal detailed description of these steps is omitted, 

row of the target block 0. as shown in part (a) of FIG. 26. As shown in FIG. 27, in step S102. if, in step S2407. a 

If the output at this point is the same as the region 40 state transition is detected, step S2408 is performed, 

evaluation result from the region evaluation ROM 609 input Otherwise, step S2409 is performed. In step S2408. the 

on the input A of the switching unit 2104. since the entire program determines whether to employ a binary region 

block is evaluated as a binary region, a switching signal conversion process or a continuous tone conversion process 

input to the A input (in this case, a 1, indicating a binary to generate the binary output signal. Then, in step S2409. a 

region, such as is shown in part (c) of FIG. 26), is trans- 45 selected switching signal is output, based on the conversion 

mitted from the switching unit 2104 to the binary signal process selected in step S2408 when a state transition has 

switching unit 610 on the signal line 611. This target block. occurred, or based on the region evaluation result when no 

which originally should have been processed as a continuous state transition has occurred. 

tone region, is thus entirely processed as a binary region. In step S2408. the density of the input pixel signal after 

However, an output of "1110" is obtained from the 50 ^ conversion to the 16 level form, is checked to determine 

attribute pattern ROM 2102. as shown in part (b) of FIG. 26. if the density is 1 or below (black). 13 or above (white), or 

As shown in part (d) of FIG. 26, a switching signal input to between 2-12 (grey). If , in step S2408. the pixel signal 

the B input and corresponding to the pattern "1110" is density is 1 or below, or 13 or above, the binary conversion 

transmitted from the switching unit 2104 to the binary signal process is selected. However, in step S2408. if the density is 

switching unit 610 on the signal line 611. Thus, since 0. 55 between 2-12. the continuous tone conversion process is 

indicating a continuous tone region, is transmitted to the selected. 

binary signal switching unit 610 for the fourth 4-pixcl block In FIG. 28, the image memory 1 through the region 

of the four 4-pixel blocks formed from the 16 pixels forming evaluation ROM 609 are the same as in the first preferred 

each row of the target block, or in other words, for V4 of the ernbodiment shown in FIG. 7. The region evaluation result 

target block 0, it becomes possible to carry out the correct « for the current block Y from the region evaluation ROM 609 

procedure for V* of the target block 0. is stored in the region attribute memory 1401. 

There are many cases in which the error shown in FIG. 25 The signal selection subsystem 102 includes the state 
occurs when the block catches on the edge of the photograph transition detecting circuit 2101 , an output procedure select- 
region. Even if one portion of the block is not correctly ing circuit 2S01. and the switching unit 2104. The output 
output the binary image output is clean. In addition, since 65 procedure selecting circuit 2501 includes two comparators 
blocks for which state transition has occurred do not nec- 2502 and 2503 and an OR gate 2504. The output procedure 
essarily contain errors, there is a possibility that a mistaken selecting circuit 2501 transmits a "T to the B input of the 



06/30/2004, EAST version: 1.4.1 



5.784,488 

23 24 

switching unit 2104 when the density of each pixel of the maximum density difference and the number of black pixels, 

target block 0 is 1 or below (black) or 13 or above (white). whether or not the target block is a continuous tone region, 

and transmits a 0 to the B input of the switching unit 2104 State transitions of the region attribute are then detected 

if the density of each pixel is between 2-12 (grey). between the target blocks and the immediately adjacent 

When a state transition has not occurred the described 5 blocks of the same row. When no state transition exists, the 
switching unit 2104 selects and transmits the region attribute binary output is selected based upon the region evaluation 
of the target block 0 which corresponds to the region result. When a state transition ^xists. the region attributes of 
evaluation result from the region evaluation ROM 609. the target and surrounding blocks are compared, to selec- 
When a state transition has occurred, the switching unit 2104 tiveiy switch between the two binary output signals within 
selects and transmits the output of the output procedure w the target block. TTius. ultimately, the error of a binary image 
selecting circuit 2501. which is input on the B input In other that has been output does not stand out noticeably, 
words, when a state transition has not occurred, the region FIG. 30 shows a flow chart outlining a fifth preferred 
evaluation result from the region evaluation ROM 609 is embodiment for the image processing method, comprising 
transmitted by the switching unit 2104 to the binary signal the second preferred enibodiment of the region evaluation 
switching unit 610 on the signal line 611. When a state 15 process S101 and the first preferred embodiment of the 
transition has occurred, the output of the output procedure signal selection process S102. Accordingly, as these pro- 
selecting circuit 2501 is transmitted to the binary signal cesses are fully described with reference to FIGS. 12 and 23. 
switching unit 610 on the signal line 611. The binary signal any further discussion of these steps is omitted, 
switching unit 610 operates as described in the first preferred a fifth preferred embodiment of the image processing 
embodiment shown in FIG. 7. 20 system 100 is shown in FIG. 31, and generally comprises the 

As shown in FIG. 29. the block size is 16 pixels in each second preferred ernbodiment of the region evaluation sub- 
row, with the number of rows n is indeterminate. The density system 101 shown in FIG. 16 connected to the first preferred 
of the three pixel block Z is 2-4. and the density of the other embodiment of the signal selection subsystem 102 shown in 
12 pixels is 14. In such a state, the block appears in the state FIG. 24. Accordingly, since these subsystems and devices 
in which it has caught on the edge portion of the interme- 25 are fully described above, except as set forth below, any 
diate tone region. In this case, since the number of black further discussion of these subsystems and devices is omit- 
pixels is 3 and the maximum density difference is 12, the ted. 

block which should have been evaluated as a continuous As shown in FIG. 31, while the attribute pattern ROM 

tone region is erroneously evaluated as a binary region. 2102 and the state transition detecting device 2101 are 

When the pixel signal of the type of the target block 0 connected to blocks of the region attribute memory 1401, the 

shown in part (a) of FIG. 29 is input to the output procedure connected blocks differ from that of the third preferred 

selection circuit 2501, a binary conversion processing selec- enibodiment shown in FIG. 24. That is, because the region 

tion signal (= 1) is output from the output procedure selection correction ROM 1402 corrects the target block 0, the target 

circuit 2501. as shown in part (c) of FIG. 29, for those pixels J5 block 0 is not stable. Thus, instead of using the target block 

having a density 14, while, for those pixels having a density 0 and its surrounding blocks 1-3 and X, as in the third 

2-4. a continuous tone processing selection signal (=0) is preferred emrxxliment shown in FIG. 24, the state transition 

output Conversely, if the output is to be the same as the detecting device 2101 is connected to the blocks 4, 5 and X, 

region evaluation result based on the results of the state which are all stable. Likewise, the attribute pattern ROM 

transition detection device 2101. the region evaluation result ^ 2102 is connected to blocks 4 and X-Z, which are also all 

(= 1) input to the A input of the switching unit 2104 is output stable. Thus, the signal selection subsystem 102 outputs the 

as shown in part (b) of FIG. 29. selection signal to the binary signal switching unit 610 

However, when the fourth preferred embodiment of the corresponding to block 4 while block 0 is corrected by the 

method is used, the correct procedure can be accomplished region correction ROM 1402. 

for the correct binary output based on the continuous tone 45 It should be appreciated that either the second preferred 

portion. Since blocks for which a state transition has embodiment of the region correction device 1402 shown in 

occurred do not necessarily contain errors, there is a possi- FIG. 17 or the third preferred embodiment of the region 

biiity of selecting the wrong binary conversion procedure for correction device 1402 shown in FIG. 22 can be used in 

correctly evaluated blocks. However, since the binary con- place of the first preferred embodiment of the region cor- 

version procedure is selected based on the pixel density, the ^ rection device 1402 used in FIG. 31. However, in the fifth 

errors do not stand out in the output binary image. preferred embodiment shown in FIG. 31. since the region 

The continuous tone image processing subsystem 103 and evaluation result is written into block "A" and the appro- 

the binary image processing subsystem 104 connected to the pnate binary output is selected for block M 4." the delay 

first preferred ernbodiment of the region evaluation sub- interval in the delay circuit 2 shown in FIGS. 19 and 20 
system 101 and the second preferred embodiment of the 33 corresponds to a 6-block portion delay interval 

signal selection subsystem 102 in this fourth preferred Since multiple characteristic amounts are extracted from 

embodiment of the image processing system 100 are the the multi-scaled input images and binary and continuous 

same as those shown in FIGS. 19 and 20. However, since the tone evaluations are performed from these multiple charac- 

region evaluation result is written into block Y and the teristic amounts, region evaluations are possible that are 
binary output is selected for the target block 0. the delay 60 much more accurate than conventional region evaluation 

interval of the delay circuit 2 is equivalent to a 2-block methods that do not use more than one characteristic 

portion. amount. By transmitting binary converted image signals or 

As described above, in this fourth preferred embodiment continuous tone converted image signals according to the 

of the image processing system 100 comprising the first region evaluation results, optimum image processing can be 
preferred ernbodiment of the region evaluation subsystem 65 accomplished for each region. 

101 and the first preferred embodiment of the signal selec- In addition, after regions are evaluated, if there are errors 

tion subsystem 10Z a determination is made, based on the in the evaluated results, the errors of the evaluated results 
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can be corrected by comparing the erroneously evaluated 
portions with the surrounding region attributes, thus making 
faster region divisions possible. 

Furthermore, after regions are evaluated, a determination 
is made as to whether or not state transitions have occurred 
in the blocks. If state transitions have occurred, switching 
between binary conversion and continuous tone conversion 
is performed within those blocks based on the state transi- 
tions. Thus, in blocks for which state transitions have 
occurred, the entire blocks are not evaluated simply as either 
binary regions or continuous tone regions, but can instead 
switch between being treated as binary regions and continu- 
ous tone regions within the blocks based on the state 
transitions. Therefore, errors in the binary images which are 
ultimately output need not stand out noticeably. Moreover, 
the attribute correction and state transition detection meth- 
ods and devices can be combined to obtain both advantages 
simultaneously. 

FIG. 32 shows a flow chart outlining a sixth preferred 
embodiment for the image processing method, comprising 
the second preferred embodiment of the region evaluation 
process S101 and the second preferred embodiment of the 
signal selection process S102. Accordingly, as these pro- 
cesses are fully described with reference to FIGS. 12 and 27, 
any further discussion of these steps is omitted. 

A sixth preferred embodiment of the image processing 
apparatus 100 is shown in FIG. 33, and generally comprises 
the second preferred embodiment of the region evaluation 
subsystem 101 shown in FIG. 16 connected to the second 
preferred embodirnent of the signal selection subsystem 102 
shown in FIG. 28. Accordingly, since these subsystems and 
devices are fully described above, except as set forth below, 
any further discussion of these subsystems and devices is 
omitted. 

As shown in FIG. 33, while the attribute pattern ROM 
2102 and the state transition detecting device 2101 are 
connected to blocks of the region attribute memory 1401. the 
connected blocks differ from that of the fourth preferred 
embodiment shown in FIG. 28. That is, because the region 
correction ROM 1402 corrects the target block 0, the target 
block 0 is not stable. Thus, instead of using the target block 
0 and its surrounding blocks 1-3 and X, as in the fourth 
preferred embodiment shown in FIG. 28. the state transition 
detecting device 2101 is connected to the blocks 4, 5 and X. 
which are all stable. Likewise, the output procedure select- 
ing circuit 2501 is connected to block 4, which is stable. 
Thus, the signal selection subsystem 102 outputs the selec- 
tion signal to the binary signal switching unit 610 corre- 
sponding to block 4 while block 0 is corrected by the region 
correction ROM 1402. 

It should be appreciated that either the second preferred 
embodiment of the region correction device 1402 shown in 
FIG. 17 or the third preferred embodiment of the region 
correction device 1402 shown in FIG. 22 can be used in 
place of the first preferred embodiment of the region cor- 
rection device used in FIG. 33. However, in the sixth 
preferred enibodiment shown in FIG. 33, since the region 
evaluation result is written into block "A H and the appro- 
priate binary output is selected for block "4." the delay 
interval in the delay circuit 2 shown in FIGS. 19 and 20 
corresponds to a 6-block portion delay interval. 

Since multiple characteristic amounts are extracted from 
the multi-scaled input images and binary and continuous 
tone evaluations are performed from these multiple charac- 
teristic amounts, region evaluations are possible that are 
much more accurate than conventional region evaluation 
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methods that do not use more than one characteristic 
amount. By transmitting binary converted image signals or 
continuous tone converted image signals according to the 
region evaluation results, optimum image processing can be 
5 accomplished for each region. 

In addition, after regions are evaluated, if there are errors 
in the evaluated results, the errors of the evaluated results 
can be corrected by comparing the erroneously evaluated 
portions with the surrounding region attributes, thus making 
10 faster region divisions possible. 

Furthermore, after regions are evaluated, a termination 
is made as to whether or not state transitions have occurred 
in the blocks. If state transitions have occurred, switching 
between binary conversion and continuous tone conversion 
15 is performed within those blocks based on the state transi- 
tions. Thus, in blocks for which state transitions have 
occurred, the entire blocks are not evaluated simply as either 
binary regions or continuous tone regions, but can instead 
switch between being treated as binary regions and continu- 
20 ous tone regions within the blocks based on the state 
transitions. Therefore, errors in the binary images which are 
ultimately output need not stand out noticeably. Moreover, 
the attribute correction and state transition detection meth- 
ods and devices can be combined to obtain both advantages 
25 simultaneously. 

While this invention has been described in conjunction 
with specific embodiments thereof, it is evident that many 
alternatives, modifications and variations will be apparent to 
those skilled in the art. Accordingly, the preferred erabodi- 
30 ments of the invention as set forth herein are intended to be 
illustrative, not limiting. Various changes may be made 
without departing from the spirit and scope of the invention 
as defined in the following claims. 
What is claimed is: 
35 1. An image processing method for converting an input 
image having continuous tone regions and binary regions 
into a binary output image, comprising: 
dividing the input image into a plurality of blocks; 
^ extracting a plurality of different types of characteristic 
values for each block; 
determining a block attribute for each block based on the 
extracted plurality of different types of characteristic 
values, the determined block attribute indicating 
45 whether the block is a continuous tone region or a 
binary region; 

correcting, for at least one of the plurality of blocks, an 
erroneously determined block attribute erroneously 
determined by the bloclf attribute determining step; 
50 detecting whether a stale transition occurs between the 
corrected block attributes of a current one of the 
plurality of blocks and surrounding blocks for each of 
the plurality of blocks; 
selecting a conversion process for each block based on the 
55 determined block attribute, wherein the conversion 
process selecting step comprises: 
selecting the conversion process based on the corrected 
block attribute of the current block when no state 
transition is detected by the state transition detecting 
60 step, and 

selecting the conversion process based on the detected 

state transition when a state transition is detected; 
converting each block to a binary image output block 
using the selected conversion process for each block; 
65 and 

outputting the plurality of converted binary image 
output blocks as the binary output image. 
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2. An image processing method for converting an input 
image having continuous tone regions and binary regions 
into a binary output image, comprising: 

dividing the input image into a plurality of blocks; 

extracting a plurality of different types of characteristic 
values for each block; 

determining a block attribute for each block based on the 
extracted plurality of different types of characteristic 
values, the determined block attribute indicating 
whether the block is a continuous tone region or a 
binary region; 

detecting whether a state transition occurs between a 

current block and surrounding blocks for each of the 

plurality of blocks; 
selecting a conversion process for each block based on the 

determined block attribute, comprising: 

selecting the conversion process based on the deter- 
mined block attribute when no state transition is 
detected for the current block by the state transition 
detecting step, and 

selecting the conversion process based on the detected 
state transition when a state transition is detected in 
the current block; 
converting each block to a binary image output block 

using the selected conversion process for each block; 

and 

outputting the plurality of converted binary image output 
blocks as the binary output image. 

3. The image processing method of claim 2. wherein 
selecting the conversion process based on the detected state 
transition comprises selecting between a continuous-tone 
conversion process and a binary conversion process based 
on the determined attributes of the current and surrounding 
blocks. 

4. The image processing method of claim 2, wherein 
selecting the conversion process based on the detected state 
transition comprises selecting between a continuous-tone 
conversion process and a binary conversion process based 
on a density value for each pixel of the current block 

5. An image processing method for converting an input 
image having continuous tone regions and binary regions 
into a binary output image, comprising: 

dividing the input image into a plurality of blocks; 
extracting a plurality of different types of characteristic 45 

values for each block; 
detennining a block attribute for each block based on the 

extracted plurality of different types of characteristic 

values, the determined block attribute indicating 

whether the block is a continuous tone region or a ^ 

binary region; 
selecting a conversion process for each block based on the 

determined block attribute; 
converting each block to a binary image output block 

using the selected conversion process for each block, 55 

comprising: 

continuous-tone converting each block whose deter- 
mined block attribute is a continuous tone attribute 
by gamma correcting each pixel of each block whose 
determined block attribute is a continuous tone 
attribute, and 

binary converting each block whose determined block 
attribute is a binary attribute; and 
outputting the plurality of converted binary image output 
blocks as the binary output image. 

6. The image processing method of claim 5. wherein the 
gamma correcting step comprises: 
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eliminating each pixel having a density below a first 

non-sensitive density; 
eliminating each pixel having a density above a second 

non-sensitive density; and 
correcting the density of each remaining pixel to conform 

to characteristics of a selected output device. 

7. An image processing method for converting an input 
image having continuous tone regions and binary regions 
into a binary output image, comprising: 

dividing the input image into a plurality of blocks com- 
prising: 

dividing the input image into a plurality of first blocks 

1 pixel wide and 1 pixel high, and 
forming second blocks M pixels wide and N pixels high 

around each first block; 
extracting a plurality of characteristic values for each 
block the plurality of characteristic values extracting 
step comprising: 

determining a number of black pixels for each second 
block, and 

determining a maximum density difference for each 
second block; 

determining a block attribute for each block based on the 
extracted plurality of characteristic values, the deter- 
mined block attribute indicating whether the block is a 
continuous tone region or a binary region; 

selecting a conversion process for each block based on the 
determined block attribute; 

converting each block to a binary image output block 
using the selected conversion process for each block; 
and 

outputting the plurality of converted binary image output 
blocks as the binary output image. 

8. An image processing system for converting an input 
image having continuous tone regions and binary regions 
into a binary output image, the system comprising: 

an image memory that stores the input image; 

a block evaluation system that inputs a current block of 
the input image and outputting a region attribute value 
for the current block, wherein the block evaluation 
system comprises a plurality of characteristic value 
extraction devices, each extraction device extracting a 
different type of characteristic value from the current 
block the block evaluation system determining the 
block attribute for the current block based on the 
plurality of different types of extracted characteristic 
values; 

a continuous tone processing system that inputs the cur- 
rent block of the input image from the image memory 
and outputting a continuous-tone-converted binary 
image output block; 

a binary processing system that inputs the current block of 
the input image from the image memory and outputting 
a binary-converted binary image output block; 

a block attribute correction device that corrects the deter- 
mined block attribute for the current block to a cor- 
rected block attribute based on the determined 
attributes of the current block and surrounding blocks 
adjacent to the current block; 

a state transition detecting system mat detects a state 
transition between the corrected block attributes of the 
current block and the surrounding blocks; 

a binary output signal selection system, the state transition 
detecting device outputting a state transition detection 
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signal to the binary output signal selection system, the 
binary output signal selection system selecting one of 
the continuous-tone-converted binary image output 
block and the binary-converted binary image output 
block for the current block based on the original or 5 
corrected block attribute output by the block attribute 
correction device for the current block and the state 
transition signal, wherein: 

when the state transition detection signal indicates a 
state transition is detected, the binary output signal 
selection system selects between the continuous- 
tone- converted output block and the binary- 
converted output block based on the detected state 
transition, and 

when the state transition detecting signal indicates a 
state transition is not detected, the binary output 15 
signal selection system selects between the 
continuous-tone-converted output block and the 
binary-converted output block based on the cor- 
rected block attribute of the current block. 

9. An image processing system for converting an input 20 
image having continuous tone regions and binary regions 
into a binary output image, the system comprising: 

an image memory that stores the input image; 

a block evaluation system that inputs a current block of 
the input image and outpuTting a region attribute value 2s 
for the current block, wherein the block evaluation 
system comprises a plurality of characteristic value 
extraction devices, each extraction device extracting a 
different type of characteristic value from the current 
block, the block evaluation system determining the 30 
block attribute for the current block based on the 
plurality of different types of extracted characteristic 
values; 

a continuous tone processing system that inputs the cur- 
rent block of the input image from the image memory 35 
and outpurting a continuous-tone-converted binary 
image output block; 

a binary processing system that inputs the current block of 
the input image from the image memory and outpurting 
a binary-converted binary image output block; 40 

a block attribute correction device that corrects the deter- 
mined block attribute for the current block to a cor- 
rected block attribute based on the determined 
attributes of the current block and surrounding blocks 
adjacent to the current block, wherein the block 45 
attribute correction device comprises: 
a plurality of pattern matching circuit components, 
a connection circuit selectively connecting the block 
attributes of the current and surrounding blocks to 
each of the plurality of pattern rnatching circuit 50 
components. 

a logic circuit logically combining outputs of the pat- 
tern matching circuit components and the block 
attribute for the current block and outpurting the 
corrected block attribute for the current block, and 55 

means for overwriting the determined block attribute 
for the current block with the corrected block 
attribute; and 

a binary output signal selection system that selects one of 
the continuous-tone-converted binary image output 60 
block and the binary-converted binary image output 
block for the current block based on the original or 
corrected block attribute output by the block attribute 
correction device for the current block. 

10. An image processing system for converting an input 65 
image having continuous tone regions and binary regions 
into a binary output image, the system comprising: 
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an image memory for storing the input image; 

a block evaluation system inputting a current block of the 
input image and outpurting a region attribute value for 
the current block, wherein the block evaluation system 
comprises a plurality of characteristic value extraction 
devices, each extraction device extracting a different 
type of characteristic value from the current block, the 
block evaluation system determining the block attribute 
for the current block based on the plurality of different 
types of extracted characteristic values; 

a continuous tone processing system inputting the current 
block of the input image from the image memory and 
outpurting a continuous-tone-converted binary image 
output block; 

a binary processing system inputting the current block of 
the input image from the image memory and outpurting 
a binary-converted binary image output block; 

a state transition detecting system detecting a state tran- 
sition between the block attributes of a current block 
and surrounding blocks adjacent to the current block; 
and 

a binary output signal selection system, the state transition 
detecting system outpurting a state transition detection 
signal to the binary output signal selection system, the 
binary output signal selection system selecting one of 
the continuous-tone-converted binary image output 
block and the binary-converted binary image output 
block for the current block based on the original or 
corrected block attribute output by the block attribute 
correction device for the current block, wherein: 
when the state transition detection signal indicates a 
state transition is detected, the binary output signal 
selection system selects between the continuous- 
tone-converted output block and the binary- 
converted output block based on the detected state 
transition, and 
when the state transition detecting signal indicates a 
state transition is not detected, the binary output 
signal selection system selects between the 
continuous -tone- converted output block and the 
binary-converted output block based on the deter- 
mined block attribute of the current block. 

11. The image processing system of claim 10, wherein, 
when the state transition detection signal indicates a state 
transition is detected, the binary output signal selection 
system selects between the continuous -tone -converted out- 
put block and the binary-converted output block based on 
the determined attributes of the current and surrounding 
blocks. 

12. The image processing system of claim 10, wherein, 
when the state transition detection signal indicates a state 
transition is detected, the binary output signal selection 
system selects between the continuous -tone -converted out- 
put block and the binary-converted output block based on a 
density value for each pixel of the current block. 

13. The image processing system of claim 10. wherein the 
state transition detecting system comprises: 

a state transition detection circuit that inputs block 
attributes of the current block and a first plurality of 
surrounding blocks adjacent to the current block and 
that outputs a detection signal based on the block 
attributes of the current block and the first plurality of 
surrounding blocks; 

an attribute partem memory that inputs block attributes of 
the current block and a second plurality of surrounding 
blocks adjacent the current block as an input address 
and outpurting an attribute pattern signal; 
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a timing generator that generates a plurality of transition 
block attributes for portions of the current block; and 

a block attribute selection switch that selectively outputs 
one of the block attribute for the current block and the 
plurality of transition block attributes to the binary 5 
output signal selection system based on the detection 
signal output by the state transition detection circuit 

14. The image processing system of claim 10. wherein the 
state transition detecting system comprises: 

a state transition detection circuit that inputs block 10 
attributes of the current block and the plurality of 
surrounding blocks adjacent to the current block and 
that outputs a detection signal based on the block 
attributes of the current block and the plurality of 
surrounding blocks; 15 

an output selection circuit that compares each pixel of the 
current block, on a pixel-by-pixel basis, to a first 
threshold value and a second threshold value and 
outputting a comparison signal indicating the compari- ^ 
son result for each pixel; and 

a block attribute selection switch that selectively outputs 
one of the block attribute for the current block and the 
comparison signal to the binary output signal selection 
system based on the detection signal output by the state 25 
transition detection circuit 

15. The image processing system of claim 14. wherein the 
output selection circuit comprises: 

a first comparator that compares the block attribute of the 
current block to the first threshold value and outputting 30 
a first comparison signal; 

a second comparator that compares the block attribute of 
the current block to the second threshold value and 
outputting a second comparison signal; and 

a logic circuit that logically combines the first and second 35 
comparison signals and outputting the comparison sig- 
nal 

16. An image processing system for converting an input 
image having continuous tone regions and binary regions 
into a binary output image, the system comprising: 40 

an image memory that stores the input image; 

a block evaluation system that inputs a current block of 
the input image and that outputs a region attribute value 
for the current block, wherein the block evaluation 45 
system comprises a plurality of characteristic value 
extraction devices, each extraction device extracting a 
different type of characteristic value from the current 
block, the block evaluation system determining the 
block attribute for the current block based on the 50 
plurality of different types of extracted characteristic 
values; 

a continuous tone processing system mat inputs the cur- 
rent block of the input image from the image memory 
and that outputs a continuous-tone-converted binary 55 
image output block, wherein the continuous tone pro- 
cessing system comprises a gamma correction circuit 
that gamma corrects each pixel of each block; 

a binary processing system thai inputs the current block of 
the input image from the image memory and that 60 
outputs a binary-converted binary image output block; 
and a binary output signal selection system that selects 
one of the continuous-tone-convertcd binary image 
output block and the binary-converted binary image 
output block for the current block based on the block 
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attribute output by the block evaluation system for the 
current block. 

17. The image processing method of claim 16. wherein 
the gamma correction circuit comprises a memory that 
stores a gamma correction curve, an input density value of 
a pixel input as an address to the memory, the memory 
outputting a ganima-corrected density value for the pixel. 

18. The image processing method of claim 17. wherein 
the gamma correction curve comprises: 

a first non-sensitive region wherein, when the input den- 
sity value for the pixel is below a first value, the 
gamrna-corrected density value is set to a first non- 
sensitive value; 

a second non-sensitive region wherein, when the input 
density value for the pixel is above a second value, the 
ganuna-corrected density value is set to a second 
non-sensitive value; and 

a sensitive region wherein, when the input density value 
for the pixel is between the first and second values, the 
gamma-corrected density value is set to conform to 
characteristics of a selected output device. 

19. An image processing system for converting an input 
image having continuous tone regions and binary regions 
into a binary output image, the system comprising: 

an image memory that stores the input image; 

a block evaluation system that the input image on a 

pixel-by-pixel basis, the input image divided into a 

plurality of first blocks 1 pixel wide and 1 pixel high. 

and that outputs a region attribute value for a current 

first block, wherein: 

the input image is divided into a plurality of second 
blocks M pixels wide and N pixels high around each 
first block, and 
the block evaluation system comprises a plurality of 
characteristic value extraction devices, each extrac- 
tion device extracting a different type of character- 
istic value from the current block, the plurality of 
characteristic value extraction devices comprising: 
a pixel density counter that determines a distribution 
of pixels of each second block relative to a thresh- 
old pixel density, and 
a density difference detector that detects a maximum 
pixel density difference between a most dense 
pixel and a least dense pixel of the pixels of each 
second block, and 
the block evaluation system determines the block 
attribute for the current block based on the plurality 
of different types of extracted characteristic values; 
a continuous tone processing system that inputs the cur- 
rent block of the input image from the image memory 
and that outputs a continuous-tone-converted binary 
image output block; 
a binary processing system that inputs the current block of 
the input image from the image memory and that 
outputs a binary-converted binary image output block; 
and 

a binary output signal selection system that selects one of 
the continuous-tone-converted binary image output 
block and the binary -converted binary image output 
block for the current block based on the block attribute 
output by the block evaluation system for the current 
block. 

♦ * * * * 
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